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Abstract 

We study generalized indicators of sensitivity to initial conditions 
and orbit complexity in topological dynamical systems. The orbit com- 
plexity is a measure of the asymptotic behavior of the information that 
is necessary to describe the orbit of a given point. The indicator gen- 
eralizes, in a certain sense, the Brudno's orbit complexity (which is 
strongly related to the entropy of the system). The initial condition 
sensitivity indicators consider the asymptotic behavior of the speed 
of divergence of nearby staring orbits. The indicators have non triv- 
ial values also in weakly chaotic dynamical systems, characterizing 
various cases of weakly chaotic dynamics. Then, using constructivity, 
local relations are proved between generalized orbit complexity, ini- 
tial condition sensitivity and the dimension of the underlying space or 
invariant measure. 

1 Introduction 

Sensitivity to initial conditions is a feature of chaotic dynamical sys- 
tems. A system is sensitive to the initial condition if nearby starting 
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orbits diverge during the evolution. This is a cause of unpredictabihty 
and complexity of the evolution. 

Sensitivity can be measured quantitatively in different ways. In the 
strongly chaotic case, when a system has exponential sensitivity, i.e. 
nearby starting orbits diverges with exponential speed. Two examples 
are Lyapunov exponents and Brin-Katok local entropy. 

As concerns the complexity of the behavior, it has been measured 
for example by the various notions of entropy and many other in- 
variants (see for example [^], chapter 3). In ^] Brudno defined the 
complexity of an orbit of a topological dynamical system, using the 
Kolmogorov (algorithmic) information content of a string (section 2). 
A set of strings is associated by a certain construction to the orbit of 
a point and then the complexity of the orbit is defined by the infor- 
mation content of the associated strings. The complexity of an orbit is 
then a measure of the rate of information that is necessary to describe 
the orbit as the time increases. 

Brudno proved that if the system is ergodic on a compact space, 
the entropy of the system is almost everywhere equal to the orbit 
complexity. In other words, if such a system has positive entropy, then 
for the algorithmic information that is necessary to describe n 

steps of the orbit of x increases linearly with n and the proportionality 
factor is the entropy of the system. This also implies that if a system 
has an invariant measure fi, its entropy is equal to the mean value of 
the orbit complexity with respect to /i. Then, in compact dynamical 
systems Brudno orbit complexity can be viewed as a pointwise version 
of entropy. 

If the sensitivity is measured by Lyapunov exponents then a re- 
lation between complexity and sensitivity is the well known Ruelle- 
Pesin theorem. Another relation, which does not requires smoothness 
assumptions, but require the knowledge of an invariant measure in 
the definition of the indicator of sensitivity is given by the theorem of 
Brin-Katok |l8|. 

The philosophical meaning of the above cited theorems can be 
resumed as follows. Under some assumptions the average rate of ex- 
ponential divergence of nearby starting orbits is equal to the average 
rate of information that is necessary to describe the orbits of the points 
of {X, T) . In the case of compact dynamical systems this motivates 
the general Ford's claim [12| that orbit complexity was a synonym of 
chaos. However we remark that if the space is not compact there are 
examples ( ||5| , 1 14 1 ) of systems with no sensitivity to initial conditions 
and hight orbit complexity. 

One of the consequences of the results proved in section 6 is that 
in the compact case the assumption of constructivity recovers a link 
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between complexity and sensitivity, both in the positive, and in the 
zero entropy case. 

In many examples of dynamical systems the entropy is 0, the speed 
of separation of nearby starting trajectories is less than exponential 
and the increasing of the information contained in n step of the orbit 
could be less than linear. This is the case of the so called Weakly 
Chaotic Dynamics. 

The question naturally arises if a quantitative relation between 
complexity and sensitivity can be found for zero entropy dynamical 



systems. This is the main aim of the paper [16]. Our answer is that 
if the system is constructive, that is, if the transition map can be 
approximated at a given accuracy (in a sense that will be clarified in 
section 2) by some algorithm then we have such a quantitative relation. 
The relation implies for example that stretched exponential initial 
condition sensitivity Q implies power law behavior of the quantity of 
information that is necessary to describe an orbit. In this paper we 



improve the results of [16| defining the indicators by simpler notations. 
This gives to the statements a simpler and stronger form, involving 
connections with the concept of dimension. 

The study of weakly chaotic dynamics was discovered to be im- 
portant for application purposes. There are connections with many 
physical and economic phenomena: self organized criticality, the so 
called chaos threshold, the anomalous diffusion processes and many 
others. In these examples of weakly chaotic dynamics the traditional 
indicators of chaos (K.S. entropy, Lyapunov exponents, Brudno's or- 
bit complexity) vanishes. These indicators are not able to distinguish 
between all the various cases of weakly chaotic dynamics. 

Some definitions of generalized entropy have been already pro- 



posed in literature (see e.g. |3^] , ||2J] , |3^] for definitions about dy- 



namical systems). The most fruitful ones were given by Reniy and 
Tsallis that found a great variety of application. See for example 



http://tsallis.cat.cbpf.br/biblio.htm for an updated bibliography of 



topics related to Tsallis entropy. In the literature relations between 
Tsallis entropy and initial data sensitivity have been proved ([32|,pT|), 



indicating that the main field of application of Tsallis entropy in dy- 
namical systems is the case of power law initial data sensitivity (if two 
points starts at distance A2;(0) then Ax{t) ~ Ax(0)t"). 

In what follows it comes out that the two ingredients we need to 
add to have interesting local statements are constructivity and dimen- 
sion. To give a formal approach to constructivity and algorithms "act- 
ing" on metric spaces we introduce the notion of computable structure. 
The formal definition and some heuristic motivations of computable 



^If two points starts at distance Aa;(0) then Ax{t) ~ Aa;(0)2' 
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structure will be given in section 2, after a short introduction to the 
notion of algorithmic information content. 

In section 3 we introduce the generalized indicators of orbit com- 
plexity. These indicators characterizes the asymptotic behavior as n 
increases of the quantity of information that is necessary to describe 
n steps of the orbit of a point. We give two definitions of such an 
indicator. The first is a straightforward generalization of the Brudno's 
definition of orbit complexity. The second is a generalization of the 



definition that was given in [14| to extend Brudno's definition to the 
non compact case. In the compact case the two definitions are equiv- 
alent. The second definition is related to the notion of computable 
structure and allows to use the features of constructivity. 

In section 4 we give definitions of initial conditions sensitivity in- 
dicators. The definition is similar to the one given by Brin and Katok 



1 18] for the local entropy, but does not use the invariant measure, and 
depends only on the topological (and metric, in the sense of distance) 
features of the dynamics. 

In section 5 we introduce a notion of complexity of points in a met- 
ric space with a computable structure. Such a complexity is a measure 
of the quantity of information that is necessary to approximate a point 
of the metric space at a given accuracy. This notion is related with 
the notion of dimension, as it was already remarked in |T^ . 

In section 6 we state the relations linking orbit complexity, sensi- 
tivity and dimension. Under the assumption of constructivity we prove 
local statements of the form 

dimensionxindicator of min sensitivity at x < orbit complexity at x 



orbit complexity at x < dimensionxindicator of max sensitivity at x 

we remark that these statements are obtained only under the assump- 
tion of constructivity (and continuity) of the transition map. No dif- 
ferentiability or hyperbolicity assumptions are needed. The equations 
gives information both in the positive and null entropy case. 



2 Algorithmic Information Theory and 
Computable Structures 

In this section we give a short introduction to algorithmic informa- 
tion theory and to computable structure and constructivity. A more 
detailed exposition of algorithmic information theory can be found in 
|3l or 
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Let us consider the set S = {0, 1}* of finite (possibly empty) binary 
strings. If s is a string we define |s| as the length of s. 

Let us consider a Turing machine (a computer) C: by writing 
C{p) = s we mean that C starting with input p (the program) stops 
with output s (C defines a partial recursive function C : S — > S). If 
the input gives a never ending computation the output (the value of 
the recursive function) is not defined. If C : S ^ S is recursive and its 
value is defined for all the input strings in S (the computation stops 
for each input) then we say that C is a total recursive function from 
S to S. The algorithmic information content (A.I.C.) of a string will 
be the length of the shortest program that outputs the string. 

Definition 1 The Kolmogorov complexity or Algorithmic Informa- 
tion Content of a string s given C is the length of the smallest program 
p giving s as the output: 

AlCcis) = min \p\ 

C(p)=s 

if s is not a possible output for the computer C then AICc{s) = oo . 

Let us see some examples. The algorithmic information content of a 
2n bits long periodic string 

s =" 1010101010101010101010..." 

is small because the string is output of a shortest program: 

repeat n times (write ("10")) 
the AIC of the string s is then less or equal than log{n) + Constant 
where log{n) bits are sufficient to code "n" and the constant represents 
the length of the code for the computer C representing the instruc- 
tions "repeat, write...". As it is intuitive the information content of a 
periodic string is very poor. On the other hand each, even random n 
bits long string 

s' =" 1010110101010010110..." 

is output of the trivial program 

u;Hte("l010110101010010110...") 

this is of length n-\- constant. This implies that the AIC of each string 
is (modulo a constant which depends on the chosen computer C) less 
or equal than its length. 

From the last definition the algorithmic information content of a 
string depends on the choice of the computer C. There is a class of 
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computers that allows an "almost" universal definition of algorithmic 
information content of a string: if we consider computers from this 
class the A.I.C. of a string is defined independently of the computer 
up to a constant. In order to define such a class of universal computers 
we give some notations that are necessary to work with strings: let us 
consider c : S — > N from the set S and the set N associating strings 
and natural numbers in the following natural way 

0^0, 0^1, 1^2, 00^3, 01^4, 10^5,... 

This correspondence allows us to interpret natural numbers as 
strings and vice- versa when it is needed. We remark that |s| < log{c{s))+ 
1. 1^ If s is a string with |s| = n let us denote by the string 
sososisi...Sn_iSn-i01. If a = ai...an and b = bi...bm are strings then 
ab is defined as the string ai...a„6i...6m- If ^ and b are strings then a ' 6 
is an encoding of the couple {a,b). There is an algorithm that getting 
the string a"6 is able to recover both the strings a and b. An uni- 
versal Turing machine intuitively is a machine that can emulate any 
other Turing machine if an appropriate input is given. Before to give 
the formal definition we recall that there is a recursive enumeration 
Ai,A2-.- of all the Turing machines. 

Definition 2 A Turing machine U is said to be universal if for all 
m G N and p S S then lA{c^^{m) " p) = Am{p)- 

In the last definition the machine lA is universal because U is able 
to emulate each other machine Am when in its input we specify the 
number m identificating A^ and the program to be runned by Am- It 
can be proved that an universal Turing machine exists. 

Definition 3 A Turing machine F is said to be asymptotically opti- 
mal if for each Turing machine C and each binary string s we have 
AICf{s) < AICc{s) + c where the constant c depends on C and not 
on s. 

The following proposition can be proved from the definitions 

Proposition 4 IfU is an universal Turing machine then lA is asimp- 
totically optimal. 

This tells us that choosing an universal Turing machine the com- 
plexity of a string is defined independently of the given Turing machine 
up to a constant. For the remaining part of the paper we will suppose 
that an universal Turing machine U is chosen once forever. 

^ In this paper all the logarithms are in base two. 
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2.1 Computable Structures, Const ructivity 



Many models of the real world use the notion of real numbers or more 
in general the notion of complete metric spaces. Even if you consider a 
very simple complete metric space, as, for example, the interval [0, 1] 
it contains a continuum of elements. This fact implies that most of 
these elements (numbers) cannot be described by any finite alphabet. 
Nevertheless, in general, the mathematics of complete metric spaces 
is simpler than the "discrete mathematics" in making models and the 
relative theorems. On the other hand the discrete mathematics allows 
to make computer simulations. This is one of the reasons why we in- 
troduce the notion of computable structure which is a way to relate 
the world of continuous models with the world of computer simula- 
tions. The set of binary strings E is the mathematical abstraction of 
the world of the " computer" , or more in general is the mathematical 
abstraction of the "things" which can be expressed by any language. 
The real objects which we want to talk about are modeled by the 
elements of a metric space {X,d). We will interpret the objects of S 
as points of X. A computable structure on a separable metric space 
{X, d) is a class of dense interpretations (/ : S — X) of the space 
of finite strings S in the metric space. The interpretations are such 
that the distance d restricted to the points that are images of strings 
{x = I(s) : X € X, s € T,) is a "computable" function. The use of com- 
putable structures allows to consider algorithms "acting" over metric 
spaces and to define constructive functions between metric spaces, that 
is, functions such that we can work with by using a finite amount of 
information. Many concrete metric spaces used in analysis or in geom- 
etry have a natural choice of a computable structure. In the following 
we will assume that the dynamical systems under our consideration 
are constructive. All the dynamical systems that we can construct 
explicitely are construcive. From the philosophical point of wiew we 
think that the assumption of constructivity is not unnatural because 
even if the maps coming from physical reality were not constructive, 
the models used to describe such a reality should be constructive (to 
allow calculations). On the other hand, to add constructivity allows 
to prove stronger theorems, avoiding pathologies coming from random 
maps. 

As it was said before an interpretation function is a way to interpret 
a string as a point of the metric space. 

Definition 5 An interpretation function on {X, d) is a function I : 
T, ^ X such that /(S) is dense in X. 

A point X e X is said to be ideal if it is the image of some string 
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X = I{s),s G S. An interpretation is said to be computable if the 
distance between ideal points is computable with arbitrary precision: 

Definition 6 A computable interpretation function on {X, d) is a 
function / : S — > X such that /(S) is dense in X and there exists a to- 
tal recursive function D:SxSxN— >Q such that Vsi, S2 G 5], n G N; 

\d{I{si),I{s2))-D{suS2,n)\<^^. 

Two interpretations are said to be equivalent if the distance from 
an ideal point from the first and a point from the second is computable 
up to arbitrary precision. For example, the finite binary strings s G T, 
can be interpreted as rational numbers by interpreting the string as 
the binary expansion of a number. Another interpretation can be given 
by interpreting a string as an encoding of a couple of integers whose 
ratio gives the rational number. If the encoding is recursive, the two 
interpretation are equivalent. 

Definition 7 Let Ii and I2 be two computable interpretations in {X,d); 
we say that Ii and I2 are equivalent if there exists a total recursive 
function D* : S x S x N — > Q, such that Vsi, S2 € S, n€ N; 

\d{h{s,),l2{s2)) - D*isus2,n)\ < ^. 

Proposition 8 The relation defined by definition is an equivalence 
relation. 

For the proof of this proposition see [0]. 

Definition 9 A computable structure I on X is an equivalence class 
of computable interpretations in X. 

For example if X = R we can consider the interpretation / : E — > 
R defined in the following way: if s = Si...s„ G S then 

I{s)= J2 ^.2["/2l-. (1) 

l<i<n 

This is an interpretation of a string as a binary expansion of a number. 
I is a computable interpretation, the computable structure on R con- 
taining I will be called standard computable structure. If r = rir2... is 
an infinite string such that lim ^'-^^^^'"^"^ = 10 then the interpretation 

■^such a string exist, see for example Q theorem 13. 
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Ir defined as Ir{s) = I{s)+^r{i)2~^ is computable but not equivalent 
to /. / and Ir belongs to different computable structures. 

In a similar way it is easy to construct computable structures in 
R" or in separable function spaces codifying a dense subset (for ex- 
ample the set of step functions) with finite strings. We remark as a 
property of the computable structures that if Br{I{s)) is an open ball 
with center in an ideal point I(s) and rational radius r and I(t) is an- 
other point then there is an algorithm that verifies if I{t) G 3^(1 (s)). 
If 7(t) G Br{I{s)) then the algorithm outputs "yes", ii I{t) ^ Br{I{s)) 
the algorithm outputs "no" or does not stop. The algorithm calcu- 
lates D{s,t,n) for each n until it finds that D{s,t,n) + < r or 
D(s, t, n) — 2^" > r, in the first case it outputs "yes" and in the second 
it outputs "no", if d{I{s), I{t)) ^ r the algorithm will stop and output 
an answer. 

We give a definition of morphism of metric spaces with computable 
structures, a morphism is heuristically a computable function between 
computable metric spaces. 

Definition 10 If (X,d,I) and (Y,d',J') are spaces with computable 
structures; a function "if : X ^ Y is said to be a morphism of com- 
putable structures if * is uniformly continuous and for each pair I G 
I, J £ J there exists a total recursive function D* : E X S X N ^ Q, 
such that Vsi,S2 £ S,nG N.- 

\d'{^{I{si)),J{s2)) - D*{s^,S2,n)\ < ^. 

We remark that ^ is not required to have dense image and then 
^' (/(*)) is not necessarily an interpretation function equivalent to J. 

Remark 11 As an example of the properties of the morphisms, we 
remark that if a map ^ : X ^ Y is a morphism then given a point 
X G /(S) C X it is possible to find by an algorithm a point y G C 
Y as near as we want to '^{x). 

The procedure is simple: if x = I{s) and we want to find a point y = 
J{zo) such that d'(*(/(s)), y) < 2""^ then we calculate D*{s, z,m + 2) 
for each z G S until we find zq such that D*{s, Zo,m -|- 2) < 2^™^^. 
Clearly y = J{zq) is such that d'{^{x), y) < 2~™. The existence of such 
a zq is assured by the density of J in y. In particular the identity is 
a morphism. 

We also remark that by a similar procedure, given a point I{sq) and 
e G Q it is possible to find a point /(si) such that d{I{sQ), /(si)) > e. 

A constructive map is a morphism for which the continuity relation 
between e and S is given by a recursive function. The following is in 
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some sense a generalization of the definition of Grzegorczyk, Lacombe 
(see e.g. |29|) of constructive function. 



Definition 12 A function ^ : {X,d,2) {Y,d',J') between spaces 

with computable structure {X,I), {Y,J') is said to be constructive if^ 

is a morphism between the computable structures and it is effectively 

uniformly continuous, i. e. there is a total recursive function / : N — > 

N such that for all x,y e X d{x,y) < 2~-^(") implies d'{^{x), "^{y)) < 
2-n_ 

If X is a space with a computable structure and T : X ^ X is 
constructive then we call {X, T) a constructive dynamical system. 

The following Lemma states that if a map between spaces with 
a computable structure is constructive then there is an algorithm to 
follow the orbit each ideal point x = I{sq). The proof can be found in 

m 

Lemma 13 If T : {X,Z) {X,I) is constructive, I I then there 
is an algorithm (a total recursive function) ^:SxNxN— >S such 
that yk,me N,so G S d{T''{I{so)), I{A{so,k,m))) < 2-"*. 

3 Brudno's definition of orbit complex- 
ity and its generalization 

Here we sketch Brudno's definition of orbit complexity. The construc- 
tion will be generalized, to provide invariants that are useful in the 
weakly chaotic case. 

Let us consider a topological dynamical system {X,T). X is a 
metric space and T is a continuous mapping X ^ X. Let us consider 
a finite open cover /3 = {Bq,Bi, ...,i?7v_i} of X. We use this cover to 
code the orbits of {X, T) into a set of infinite strings. A symbolic 
coding of the orbits of X with respect to the open cover {-Bj} is a 
string listing the sets Bi,..,Bn visited by the orbit of x during the 
iterations of T. Since the sets Bi may have non empty intersection 
then an orbit can have more than one possible coding. More precisely. 
If X € X let us define the set of symbolic orbits of x with respect to /? 
as: 

M^) = V e {0,1, ...,N- 1}N : Vn G N,r"(x) G 

■^However we remark that for the next definition to be well posed the continuity is not 
strictly necessary. 
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The set (pi3{x) is the set of all the possible codings of the orbit of x 
relative to the cover 

The Brudno's definition of orbit complexity of x with respect to /3 

is 

K{x, T, 13) =limsup min ^ — ^ 

where oj'^ is the string containing the first n digits of lo. We remark 
that Lj" is not a binary string. It is easy to imagine how the definition 
of algorithmic information content can be extended to strings made 
of digits coming from a finite alphabet. This definition measures the 
average quantity of information that is necessary to describe a step 
of the orbit of x by the open sets of (3. The Brudno's orbit com- 
plexity is positive when the quantity of information increases linearly. 
This is the case of positive entropy (see theorem [Tsl ). When the sys- 
tem is weakly chaotic the information increases less than linearly and 
Brudno's complexity is 0. As we will see next there are many possible 
different behavior of the quantity of information in weakly chaotic dy- 
namical systems. The generalized indicator will be able to distinguish 
between these different behaviors. 

We give a measure of such an asymptotic behavior by comparing 
the quantity of information necessary to describe n step of the or- 
bit with a function / whose asymptotic behavior is known. For each 
monotonic function /(n) — > oo we define an indicator of orbit com- 
plexity by comparing the asymptotic behavior of AICu{ijj'^) with /. 
The complexity of the orbit of x € X relative to / and (3 is defined as: 

K-^ {x,T, P) =limsup min — - 

Taking the supremum over the set of all finite open covers (3 of the 
metric space X it is possible to define the complexity of the orbit of 
x: 

K^{x,T) =sup {Kf{x,T\P)) 

/3 

This definition associates to a point belonging to X and a function 
/ a real number which is a measure of the complexity of the orbit of x 
with respect to the asymptotic behavior of /. For example, if / is the 
identity: f{n) = n this definition coincides with the original Brudno's 
one. We remark that it is important to suppose that sets in the covers 
are open (see the discussion in |8|, [5| , []T4| , P] ) . 

Generalized orbit complexity is invariant under topological conju- 
gation, as it is stated in the following theorem whose proof follows 
directly from the definitions: 
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Theorem 14 If the dynamical systems (X, T) and (y, S) are topolog- 
ically conjugate, and it : X ^ Y is the conjugating homeomorphism, 
and 7r{x) = y then K^{x,T) = K^{y,S). 

In the literature (see e.g. [|], ||, [|], many rela- 

tions have been proved between orbit complexity and other forms of 
complexity of a dynamical system (Kolmogorov entropy, topological 
entropy and others) and with other problems concerning orbits of a 
dynamical system. The following is of particular interest: 

Theorem 15 (Brudno's main theorem.) Let {X,T) be a dynamical 
system over a compact space. If fi is an ergodic probability measure on 
{X,T), then 

K'\x,T) = h^{T) 

for II- almost each x ^ X. 

Where h^{T) is the Kolmogorov entropy of {X,T) with respect to 
the invariant measure ii. We also recall the following lemma which will 
be used lather. 

Lemma 16 // a and (3 are open covers of X and a is a refinement 
of (3 then 

(x, r, f5) < (x, T, a) 

From now on in the notation Rf (x, T) we will avoid to explicitly 
mention the map T when it is clear from the context. We now give 
some example of different behaviors of R^ (x). If x is a periodic point 
it is easy to see that since the information content of a n digit long 
periodic string is < log{n) + C then Rf {x) = if log{n) = o{f), 
moreover R^°^^'^\x) = 1, this follows by the (not so trivial) remark 
that if w is a periodic string then limsup '^j^l'^) ^ = 1 (while the 



liminf is equal zero). By theorem 15 it follows that if a system is 
compact, ergodic and has positive Kolmogorov entropy then for almost 
all points we have R^ (x) = oo if / = o{id) and R"{x) = h^. We 
also remark that (when the space is compact) the linear one is the 
maximum over all the possible asymptotic behaviors. Indeed if X is 
compact, for each e there is a finite cover V made of balls with radius 
e, then a program that follows n steps of the orbit of any point with 
the accuracy e can be simply made by listing n balls of the cover, 
then, if X is compact then min A/C[/(u;") < an + C, where a 
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....A^ A^ 



Figure 1: The map and the partition Ai 



is the logarithm of the number of elements in the cover V . Another 
important example is the piecewise linear Manneville map: 

TJ:,) = { - + ^^-1 ^ ^ < ^^-1 (2) 

a < X < 1 



with = " 1 , € A^, z € R, z > 2. This is a P.L. version of 

the Manneville map T[x) = x + (mod 1) (see /15 i). 

The Manneville map was introduced in ||2^ as an extremely sim- 
plified model of intermittent behavior in turbulence, then its mathe- 
matical properties was studied by many authors (e.g. [^],[^]). And 
the map was applied as a model of other physical phenomena ( [|^,||2|). 

It is proved in ||T^ and Q following the ideas of ||l^ that for almost 
each X (for the Lesbegue measure) [x) = if = o{f{n)), with 
a = . And [x) = cxd if f{n) = o(n"). Then for almost each 
point we have that the information content of an orbit is Lesbegue 
a.e. increasing as a power law with exponent a. 

3.1 Another definition of orbit complexity 

We now give another definition of orbit complexity. This definition is 
equivalent to the previous one when the space is compact and has a 
computable structure. The new definition allows to exploit the features 
of constructivity. Another feature of the new definition is that extends 
Brudno's definition to the non compact case (see, e.g. p 
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Let {X,l) a separable metric space with a computable structure 
X. To interpret the output of a calculation which is a finite string as a 
finite sequence in X let us consider an interpretation function / and 
a total recursive surjective function. 

Q : E ^ S* 

where S* is the set of finite sequences in S. Q associates to a string a 
sequence of strings that will be interpreted as a sequence of points as 
follows. Now let us consider an universal Turing machine U. For each 
program p we define U (p) G X* (the set of finite sequences in X) as 

Uip)=IiQ{U{p))) 

where / is extended in the obvious way to a map from the space 
S* to X*. Ui{p) G X is defined as the i-th point of U{p) . With 
this definition we can interpret the output of a calculation as a finite 
sequence in X. We remark that given Q and a sequence of strings 
si, it is possible by an algorithm to find a single string s such 

that Q{s) = (si, ...,Sn)- 

Definition 17 We define the algorithmic information content of the 
sequence x,T{x), ...,T"'{x) € X* at accuracy e and with respect to the 
interpretation I as: 



lC^{x,n,e) = min||p| s.t. U{p) G max {d{Ui{p),T\x))) < el . 

t 0<i<n J 

The calligraphic /C is used to distinguish this definition from the defi- 
nition of Brudno. 

As before we choose a function / and consider the asymptotic 
behavior for n — > 00 and define lC^'^{x,e) : X x R ^ R as: 

]C-^'^(x,e) =limsup — ^ ' ' \ 

n^oo f{n) 



Remark 18 /C^'^ (x, e) is a non increasing function with respect e. 

Finally, we consider the behavior when e goes to and we define 
}Cf'^{x) : X ^ R as 

Definition 19 The orbit complexity of x with respect to f and the 
interpretation I is defined as: 

IC^'\x) = sup IC^'\x,e). 

e€R+ 
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Theorem 20 If X is compact then for each computable interpretation 
I, for each x € X 

)C^'^{x) =Kf{x) 

This result shows that in the compact case the 'calhgraphic' orbit 
complexity does not depends on the choice of the computable structure 
on the space. 

Proof. First part. Let us consider an open cover V and {x, V), 
if is a refinement of V made of balls Bq, ...,Bm with radius e, by 



Lemma |16| we have 

Kf{x,V,) > Kf{x,V) 
since each cover has a refinement made of e balls, then 

K{x) = sup K{x,Ve). 

Ve&t— covers 

Let us consider / and consider sq, •••,Sm such that B{I{sj),2e) D Bj 
let us prove that for each 

Kf{x,V,)>JCf'^{x,2e) (3) 

this follows from the fact that there is a constant C such that K{x,n,Ve)+ 
C > /C^(x,n,2e). Indeed given a minimal program p generating n + 1 
steps of a symbolic orbit of x with respect to V^: U{p) = uj"^ = (io, ••, «n) 
there is a a program p' containing p that codifies the following proce- 
dure 

1) it calculates running the given program p 

2) it has a finite list that associates to each symbol in a;" represent- 
ing a ball Bi of the cover the string Sj. With this list it associates 
to Lij" a finite sequence of strings Si 

3) it calculates the single string s* such that Q(s*) = 

and output this string. Then IC^ {x,n,2e) < \p'\, \p'\ = \p\ + C, then 
Kf{x,Ve) > /C-^'^(x,2e) and then the statement is proved. 

second part. K^'^x) > i^(x).To prove this we first describe a cer- 
tain class of nice balls covers. Suppose that a = n), r„)} 
is a ball cover of the metric space X whose elements are balls with 
centers yi and radii r^. We say that q is a nice cover \i X CU Bi{yi, S-)- 

i 

In other words a is a nice cover if dividing the radius of the balls by 
2 we have again a cover. 



By Lesbegue Lemma about open covers and lemma |16| we know 
that VA we can choose a rational e, such that there is a nice cover 
P = {B{I{si),2e),...,B{I{sm),2€)} such that \Kf {x, P) - Rf {x)\ < A 
and thus we can consider covers of the form (3 to calculate Brudno's 
orbit complexity. Now let us suppose to have a minimal length program 
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p such that Vz G {1, ...,n},d{Ui{p),T^{x)) < e; there is an algorithm 
that calculates a sequence relative to /?. This algorithm can be 
coded in a program p' with \p'\ = \p\ + c. The algorithm calculates 
for each i a string Zi such that I{zi) = Ui{p) . Then it finds a ball 
of /?' = e), e)} that contains I{zi). This can be 

done using the computable structure in the following way: for each 
j, k it calculates D{zi, Sj, k) until it finds a string sj G {si, .., s^} such 
that d{I{zi), I(sj)) < e (this process must stop because is an open 
cover). The last statement implies that I{zi) G B{I{sj), e) and T*(x) G 
B{I{sj),2e). Thus it is possible to construct a symbolic orbit relative 
to the cover 

Since K is independent of the choice of an interpretation we obtain 

Corollary 21 If X is compact, if I and J are computable inter- 
pretations (not necessarily from the same computable structure) then 
/C^'/(x) = /C-^'/(x). 

If X is not compact the two definition of orbit complexity are 
not equivalent. For example if X = R with the standard computable 
structure, the trivially non chaotic dynamical system T{x) = x + 1 is 
such that K'^'^{x) = oo,Vx G R and )C^''^'^{x) = Vx G R equipped 
with the standard computable structure. 

If X is not compact however the orbit complexity does not depends 
on the choice on / G X. 

Lemma 22 // 1, J are computable interpretation functions from the 
same computable structure: I,J then /C-^'^(x) = }C^''^{x). So the 
orbit complexity does not depend on the choice of the interpretation 
I in the computable structure I and we can define lC^'-^{x) = K,^'^ {x) 
for some I El. 

The proof is similar to the previous one and we omit it. 

The "calligraphic" orbit complexity is invariant for constructive 

isomorphisms of dynamical systems over non compact spaces, as it is 
stated in the following propositions. We omit the proof that is similar 
to the previous ones. 

Theorem 23 // (X,d,T), (Y,d',T') are topological dynamical sys- 
tems over metric spaces with computable structures I, J and f is onto 
and it is a morphism between {X, d, I) and (y, d', J) such that the fol- 
lowing diagram 

f 

X ^ Y 

T i IT' (4) 

X ^ Y 

f 



16 



commutes, if X G X and y = f{x) then K?''^ {x) > K,'^'^ {y). 

4 Initial condition sensitivity 

We now define two generalized indicators of initial condition sensitiv- 
ity using a construction similar to the Brin-Katok local entropy. The 
generalized indicators are constructed in a way that they have non 
trivial values in the weakly chaotic case. Let X be a separable metric 
space and T a function X — > X. 
Let us consider the following set: 

B{n, X, e) = {y G X : d{T\y),T\x)) < e Vi s.t. 0<i<n}. 

B{n, x, e) is the set of points "following" the orbit of x for n steps at 
a distance less than e. As the nearby starting orbits of (X, T) diverges 
the set B{n, x, e) will be smaller and smaller as n increases. The speed 
of decreasing of the size of this set considered as a function of n will 
be a measure of the sensitivity of the system to changes on initial 
conditions. 

Brin and Katok used the set B{n,x, e) for their definition of local 
entropy 0. In their paper the measure of the size of B{n, x, e) was the 
invariant measure of the set. 

If we are interested to approximate the orbit of x for n steps we are 
interested to know how close we must approach the initial condition x 
to ensure that the resulting approximate orbit is close to the orbit of 
x; another possible measure of the size of B{n, x, e) is then the radius 
of the biggest ball with center x contained in B{n, x, e). 

r{x, n, e) = sup r 

Brix)cB{n,x,e) 

Or the radius of the smaller ball that contains B{n, x, e) 
R{x, n, e) = inf R 

Bji(x)DB{n,x,t) 

The generalized initial data sensitivity indicators at some point x 
will be a family of real numbers indicating the asymptotic behavior of 
how faster orbits coming from a neighborhood of x will diverge. In a 
certain sense the behavior of r(x,n,e) indicates the maximum initial 
data sensitivity at x, while R{x, n, e) indicates the minimum initial 
data sensitivity at x. 
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For this purpose we measure how faster —log{r{x, n, e)) increases 
as n increases, i.e. we consider the asymptotic behavior of the se- 
quence —log{r{x, n, e)) as n increases. Let / : N ^ R be a monotone 
sequence, such that lim fin) = oo. First we define 

n^oo 

Definition 24 We define r{ : X ^ H as 

f -log{r{x,n,e)) 

[x) =limsup Tr\ 

n-^-oo jyn) 

and 

Rf -.X as 

RI{x) =limsup ^ ' — 

n— »oo / (n) 

The following lemma implies that r/(x) and R({x) are monotone 
functions with respect to e. 

Lemma 25 If e > 9 then rl{x) < r^{x), R({x) < R^ix). 

Proof. Obvious □ 

Definition 26 We define the indicator of maximum initial data sen- 
sitivity at X {x) : X — >■ R as 

{x) = sup r[{x) 

eGR+ 

in the same way we define the indicator of minimum initial data sen- 
sitivity R^{x) : X — > R 

R^{x) = sup R{{x). 

eeR+ 

The classical definition of dynamical system sensitive to initial con- 
ditions is related to our last definitions. To say that a system is sensi- 
tive to initial conditions is equivalent to say that there is a 5 such that 
r{x,n,6) is infinitesimal for all the x G X: the proof is immediate. 

Definition 27 A dynamical system {X, T) is said to have sensitive 
dependence on initial conditions if there is a 6 such that for each x & X 
and every neighborhood U of x there is y E U and A; G N such that 
d{T^{x),T^{y)) > 6. 

Proposition 28 A system has sensitive dependence on initial condi- 
tions if and only if there is a uniform 6 such that Vx G X r{x, n, S) 
goes to as n increases. 



18 



We give some example of different beliaviors of r(x) and R{x) in 
dynamical system over the interval [0, 1]. 

The identity map T{x) = x. In this map Vn B{n, x, e) = {y G [0, 1], \y— 
x\ < e} then if we choose for example x = ^ we have i?(^,n,e) = 
r(i,n,e) = e. Then = rl{^) = for each / (such that / is 

not decreasing and lim f{n) = oo) and R^{^) = = 0. The 

same arguments can be applied to the ergodic irrational translation 
on [0, 1]: T{x) = x + t (mod 1) where t ^ Q obtaining the same kind of 
initial data sensitivity as the identity (indeed both the maps are not 
sensitive to initial conditions). 

The one dimensional baker's map T : [0, 1] [0, 1], T{x) = 2x (mod 1). 
If we choose for example rr = , we have B{n, 0, e) = {y € [0, 1], < 
y < 2""e}, Ri{0) = r/(0) =limsup and RJ'{0) = r-^(O) =limsup 

that is i?^'^(0) = r^'^(O) = 1, i?^(0) = r/(0) = if /(n) = o(n) and 

-R'^(O) = r-^(O) = oo if n = o(/(n)). In other words the baker's map 
has exponential initial data sensitivity at 0. 

The piecewise linear Manneville map T : [0, 1] [0, 1] defined in 

Equation |2[ In this example (fig. 1) any neighborhood of the origin 

Bf: = [0, e) is subdivided in a sequence of intervals Ak = {Ck,(,k-i],Ck ~ 
1 

k 2^-1 and if A; > 1 then T{Ak) = A^-i- Let us choose x = 0, then 
i?(n, 0,^fc) = [0,^fc+„). Then a point starting near to the origin goes 
away with a power law speed. By this we find r-^ (0) =limsup . n 

that is r'^(O) = if /(n) = log{n). In other words the map T{x) 
has power law sensitivity to initial condition at the origin. In |jl6[ it is 
proved that (while the sensitivity to initial condition at the origin is 
a power law) for almost all other points in [0, 1] we have a stretched 
exponential sensitivity. 

Let us consider the following map T : [—1,1] x [—1,1] — > [—1,1] x 

[— 1, 1] defined asT(^| = (^~'~^ (mod 2) j r^j^-g g^ample is a 

\ y J \ y ^> ) 

simplification of the Casati map ||9|. Let us consider the initial data 
sensitivity at the origin. It can be calculated that r(0,n, e) decreases 
asymptotically (modulo lower order terms) as then r^°9^'^^ (0) = 1 
and rf {{)) = oo for any o{f{n)) = log{n). Conversely i?(0,n, e) is 
constant because the map is the identity on the axis y = and then 
{y = 0} n -6(0, e) C -6(0, n, e) for each n. From this, since R{0, n, e) is 
not infinitesimal it follows that -R-^(O) = for each /. 
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5 Complexity of points 



Now we define a function S {x,e) : X x R — > R, tlie function is a 
measure of the complexity of the points of X. The function is not 
increasing with respect to e and measures how much information is 
necessary to approximate a given point of X with accuracy e. Thus it 



is a function that does not depend on the dynamics. In |13] a definition 
of local entropy for points of metric spaces was based on this idea and 
connections between S and the concept of dimension are shown. In 
particular S{x, e) is related to the local dimension of X at x. 

We now recall the results and reformulate it in a way to be used 
in dynamical systems. 

Definition 29 // {X, d, X) is a metric space with a computable struc- 
ture I, I is an interpretation function in X, hi an universal computer. 
The information contained in the point x with respect to the accuracy 
e is defined as: 

S\X,x,e) =min{\p\ s.t. d{I{U{p)),x) < e] . (5) 

In the notation S^{X,x,e), in the following the space X will not 
be specified when it is clear from the context. 

The function S depends on the interpretation /, the function S 
depends also on the choice of lA. Changing the choice of the universal 
Turing machine lA will change the value of S" by a constant. Since in the 
following we are interested to the asymptotic behavior of S\X,x,e) 
when e goes to the choice of lA is not relevant. 

Now we see the relations between S and the concept of dimension. 
Let F C X be a completely bounded metric subspace of X. We recall 
the definition of box counting dimension: let 

ns{F) = min{n € N, such that 3xi, x„ such that U B{xi, 5) D F} 

i 

(6) 

be the minimum number of 6 balls that cover F, the upper and lower 
box counting dimension of F are defined as: 

dsiF) =Urmnf ^^^^^ 
S^o -logd 

MF) =Umsup^^^^^. 

-logo 

An equivalent definition can be given by considering instead of 
the maximum number of disjoint balls that are contained in F. If 

{xo, C F are such that d{xi,Xj) > e yi,j,i ^ j we say that the 

{xq, ...,Xi} forms an e net. 
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Let us consider the maximum cardinality n's{F) of a 5 net with 



centers in F. It can be easily proved (see e.g. |11] pag 39) that n^siF) < 
n's{F) and n's{F) < ns{F) and then the two quantities give rise to 
the same definition of box counting dimension. 

The box counting dimension is widely used in dynamical systems 
and their applications. Some of its feature differs from the Hausdorff 
dimension. For example the following holds 

Proposition 30 If X C F then 

dB{X) = dsiX), dB{X) = dsiX) 

where X denotes the closure of X. 

for the proof see for example |11] page 44. Hence countable sets may 
have positive dimension. In general we have d{X) < < dBiX), 

where d{X) is the Hausdorff dimension of X. 

Proposition 31 Let {Y,d,I) is a metric space with a computable 
structure I £ I and dB{Y) = d then for each x and 6, if e is small 
enough, i.e. 3e such that Ve < e 

S\x,e) < -{d + 6)log{e). 

Proof. 

We prove that 3C such that for each x £ X and 5 > exists e 
such that Ve < e 

S'{x, e) < -{d + -)log{e) + log{log{e)) + C. 

from this proposition ^ follows easily. 

First let us suppose that e is of the form e = 2~^,z S N. We 
describe a recursive procedure P{nx,e) : N x Q ^ S such that each 
point x of y is 3e near to I{P{nx,e)) for some n^^ G N (i.e. Mx G 
X 3nx s.t. d{x, I{P{nx, e))) < 3e). P{nx, e) builds an e net of Hx balls 
and stops giving the center of the last ball found as the output. Let 
So be the first string of S lexicographic ordered. 

P{nx,€) starts from I{so) with a list L containing sq. Then it 
consider each string of S (in lexicographic order) sq, si, ... at the first 
step L = {sq}, the procedure looks for a string such that 

d(/(s,J,/(so)) >e 

(as it was explained in section 2.1) then it adds si to the list. And so 
on, by induction at the n— th step it searches for Si„ such that 

yseLd{I{siJ,I{s))>e 
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and it add it to L. When n = Ux the procedure stops and outputs the 
last string in the hst. 

In this way we build an e net. Let us call np the maximum number 
of centers that can be found by such a procedure, i.e. \i Ux <np then 
the procedure stops. 

Since the dimension of y is d and at most we can have n' ^ balls. 
For each 5 > 0, 3e such that Ve < e 

nx<np < n'e < e"('^+f ^ 

Now we remark that each x Y must be 3e near to one of these 
centers xq, ...,Xnp, because if there is x, such thatVi < np d{x, Xi) > 3e 
then the procedure will find it and add it to the net, contradicting 
the maximality of np. Then the information that is sufficient to ap- 
proximate X at accuracy e is: the code for the procedure P (which is 
constant with respect to e), the number < £"('^+2), whose binary 
length is < log{nx) + 1, and the information that is necessary to give 
e = that is about log{z) = log{log{e)). 

Then for each 5 we have for e small enough of the form e = 

5(x,e) < log{nx)+log{log{e))+C < logiC-)-^''+l^)+logilog{e))+C < 

(7) 

< -{d+-)log{e)+log{log{e))+C. 

If e is not of the above form the statement follows from the remark 
that if e is small enough and |^ holds even for 2['°f^l then 

S^{x,e) < 5^(x,2['°3^1) < {d + ^)logi2V''9''i) + log{log{e)) + C < 
<id+ ^){logie) + 1) + log{log{e)) + C. 

□ 

Remark. If T is continuous then the closure of an orbit is an invariant 
set. 

Lemma 32 If Xn and yn are sequences in X and d{xn,yn) ^ 2~" 
then dB{{xi}i(z-f^) = dBi{yi}ieN) = ^^({xiljgN U {yjjigN)- 

Proof. Let {Bi} be a minimal cover of {xi} made of balls Bi with 
radius e and #{Bi} = as defined in |, then {25if| is a cover of 

^2Bi is a ball with the same center as Bi and double radius. 
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all points of {yi} but some of the yi such that d{xi,yi) > e and these 
points are at most —loge many. Then n2t{{yi}) < ne({xj}) —loge, then 

and then dB[{yi\) < dB{{xi}). In the same way it is possible to obtain 



the reverse inequality and by the use of proposition 30 the proof of 
Mixi}) = dB{{xi}\J {yi}). □ 

Proposition 33 Let {X,I) be a metric space with a computable struc- 
ture and T : X ^ X such that {X,T) is constructive. If x is contained 
in the closure of the orbit of an ideal point: x € O = orb{I{so)) then 
31 E I, such that for each 5 if e is small enough 

S^{x,e) < -{dsiO) + 5)loge. 

Proof. Let us consider the following interpretation function on X 

I{s) = < ^?\^)^ ^■'^f ?'^/ where In is some interpretation in I and 
[ h{s) tfs = Is' 

Ii is constructed in the following way: if A{n,e,So) is the algorithm 
to follow the orbit of /(sq) introduced in Lemma ^S], then 

/i(s) = Io{A{so,c{s),c{s))) 

where c{s) is the natural number associated to s (Section. 2). If T 
is constructive then / and Iq are equivalent. Since the distance of 
the approximate orbit Iq{A{sq,c{s),c{s))) from the real orbit of x 
decreases exponentially, by the above lemma 52| 



dB{{h{^)}) = dB{0) 



and if we consider the space O = {Ii(S)}uO we have dB{0) = dB{0). 
Now we consider the metric space O with the interpretation Ii we have 
trivially that 3C such that 

S^{X,x,e) < S^'{d,x,e) + C 

where S{X...) means the information need to approximate x consid- 
ered as a point of X. Moreover by Proposition ^ for each 5 if e is small 
enough S^^{d,x,e) < -(^^(O) + 6)log{e), and then S^{X,x,e) < 
S^^{d,x,e)+C < -(dB{d) + 5)loge + C = -(dB{0) + 6)log{e) + C 
and the statement is proved. □ 

Proposition 34 For each I, for each x but a set F with d dimen- 
sional Hausdorff measure H^^F) = 0, for each 6, if e is small enough 

S\x,e) > -{d-5)logt. 
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Proof. By theorem 12 [|T^], page 1293 the set 

W'^ = {xeX s.t. liminf ^^^"^'^ < d} (8) 

has dimension < d. 

By contradiction if x is such that there is a 5 such that there is a 
sequence ej — > such that for each i S{x,ei) < —{d — 5)log{ei), then 
4^ <d-S, then 

, 5'(a;,e) 

limmj — ; < d — 

e^o -loge 

if e = 2-"i then /imm/ ^^^f^ < d-6. Since 5(j;, 2-^-^) < 5(x, 2^"*(-t)) < 
S{x, 2-T+i) then ^imin/ ^^^^ <d-5 and then by | x € U VF"^' 

jGN,i-^oo d.'<d 

and this union of sets has d dimensional Hausdorff measure □ 
If /i is a measure on X let us consider 

d.Ax) =liminf ; — 

' e^oo log{e) 

d^{x) is a sort of local dimension of the measure /x with respect to 
the metric of X at the point x and was widely studied in the theory 
of dynamical systems (see for example the book 



Proposition 35 For jjL almost each x, for each 5, 3e s.t. e < e implies 
S{x,e) > -{d^{x) - 6)loge. 

For the proof of this proposition we need some additional lemmata 
and remarks. 

Remark 36 By the proof of Proposition |^ if we have that x is such 
that 35 and ej — > s.t. S{x,ei) < —{d^{x) — 5)log{ei), then 

:= liminf '^^^'.^ < d^{x) - 5. 



Lemma 37 Let d,c,5 > 0, let B C X such that > and Vx G 

B d^{x) >d + c. IfA = {xeB s.t. 36 s.t. <d-d}, then 

fi{A) = 0. 
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Proof. Since & A d^{x) > d + c then Vx G ^, if 7 is big enough, 

then there is a 7 > and a set A' C A with /u(^') > such that if 
X G ^' V7 > 7 fi{B{x,2-^)) < 2-'^('^+f) uniformly on all A'. 

By the remark above for each k, each x & A is contained in 
some bah B{I{U{p)),2''') with \p\ > and ^ < d, that is V/c G N 

_l£i 

Ac. U B(I(l{(p)),2 d). Let us consider the measure of one of 

{p\k<\p\} 

these balls . If ^-1 > 7 and B{I{s), 2~^), is such that B{I{s), 2-^)n 

A^i/} then B{I{s), 2~^) C B{y G yl, 2~^+^) then exists y G vl such 

that /i(S(/(s),2-^)) < /z(B(y,2^+i)) < 2-^('^+t). Then, since 
for each k there are at most 2^^^ programs of length k 

{p|fc<|p|,B(/(s),2"~)nA7^0} 

since i < and k is arbitrary the last sum can be set as small 

as wanted the statement is proved. □ 

The last lemma implies an a.e. relation between dimension and 
S{x,e): 

Lemma 38 For fi a.e. x S^^^{x) > d^{x). 

Proof. If conversely S^^^{x) < d^{x) on a set A' with ^{A') > 
it is possible to find a constant c and a set A" , fJ-{A") > such that 
S<^^P(x) <c< d^{x) on A", by lemma 16 we obtain n{A") = 0. □ 

By this last lemma and Remark 36 the proof of Proposition 35 
follows directly. 



6 Initial data sensitivity and orbit com- 
plexity 

Now we are ready to state the first proposition linking orbit complexity 
to initial data sensitivity, for the proof see . 

Proposition 39 If {X, T) is a dynamical system on a space {X, d, I) 
with a computable structure I, I and T is constructive. There are 
constants ci and C2 such that for all x ^ X,n ^'^,e ^ R"*" 

IC^ {x, n, 2e) < (x, r(x, n, e)) + log{n) + ci (9) 
S\x, R{x, n, 3e)) < /C^(n, x, e) + C2. (10) 
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We remark that the presence of the term " +log{n)" in equation ^ is 
due to our simple definition of AIC. If instead of the plain algorithmic 
information content of a string s we had used AIC{s\lenght{s)) (the 
algorithmic information content of a string given its length) the term 
" + log{n)" would disappear from Equation 

In the next theorems we prove some relations between our general- 
ized indicators of initial data sensitivity, orbit complexity and various 
notions of dimension of the space X. 

In next theorem it is also considered the dimension of the closure 
of an orbit containing our initial point x. This gives a relation that in 
a certain sense involves the dimension of attractors. 

Theorem 40 // [X, T) is a constructive dynamical system over a 
compact metric space with a computable structure {X, d, T). If f is 
such that log{n) = o{f{n)) then 

Kf{x)<dB{X)rf{x). (11) 

If f{n) = log{n) then we have 

K'°s(x) < dB{Xy"3{x) + 1. 



If X is contained in the closure of the orbit Oif^gg^ of some ideal 
point I{sq) and log{n) = o{f{n)) then 

KS{x)<dB{Oi^))rf{x) 

and 

K'"3{x)<dB{Oi^)y"^{x) + l. 

Proof. Since the space is compact then lC^'\x) = {x) and then 
it is sufficient to prove the statement for K^'^x). Let us suppose that 
r(x, n, e) is infinitesimal. For each 5 > if n is big enough, ( and then 



r(x, n, e) is eventually small), by proposition and proposition 31 



lC\x, n, 2e) S^{x, r{x, n, e)) + log{n) + ci 

W) ^ W) - 

^ -{dB{X) + 5)log{r{x, n, e)) + login) + C 
fin) 

If log{n) = o{f{n)) by taking the limsup for n — > oo and limit for 


/C^(x) < (dB + 6)r^{x) 
since 6 is arbitrary we obtain K-f'^{x) < dB{X)rf {x). 
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If /(n) = log{n) then by Proposition 39 we obtain in the same way 
as before 

K,^{x, n, 2e) S^{x, r{x, n, e)) + log{n) + ci 
log{n) login) 

and we conclude as before. 

Now suppose that x is contained in the closure of the orbit of 
some ideal point. By Proposition 33 we have that there is an / G Z 
and C € N, such that for each 5 if e is small enough 

S'{x, e) < (dBiOj^)) + 5)loge + C. 

Now as before by Proposition ^ 

}C^{x,n,2e) {x,r{x,n,e)) + log{n) + ci ^ 

W) ^ W) - 

^ -{ds + d)log{r{x, n, e)) + log{n) + C 

- IF) 

for each 5 > if n is big enough and we can conclude as before. If 
r{x,n,e) is not infinitesimal (and V/ [x) = 0) then by Proposition 
39 we have that /C^(x,n, e) < logn + C then the statement follows 
trivially. □ 

We remark that in the above theorem the difference between the 
statements when f{n) = log{n) and log{n) = o{f{n)) comes from the 
definition of the information content of a string (see remark before 
proposition |39| ). 

Theorem 41 // X is compact, {X, T) is constructive, for each x but 
a set F with d dimensional Hausdorff measure Hci{F) = 

Kf{x) > d Rf{x). 

Proof. Again the space is compact and then K,f'^{x) = JC^ (x) then it 
is sufficient to prove the statement for /C-^'^(x). By proposition ^ 

S\x, R{x, n, 3e)) < lC\n, x, e) + C2. 



If R{x, n, e) goes to as n goes to infinity by Proposition 34 we obtain 
that there is a set F with Hd{F) such that if x G X — F V(5 , if n is 
big enough 



— {d — 5)log{R{x, n, e)) < S\x, R{x, n, 3e)) < lC\n, x, e) + C2- 
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Dividing by /(n) and taking the limsup for n ^ oo and hmit for 
e — > as before we have 

JCf{x) > {d-6)Rf{x) 

and we conclude as before. If R{x, n, e) is not infinitesimal then R^{x) = 
and the statement is trivially true. □ 

Theorem 42 If fj, is a measure on X then for almost each x 

K^{x) >dJx)Rf{x) 



Proof. As before by Proposition ^ and Proposition ^ for almost 
each X X 

~idfi{x) ~ 5)log{R{x, n, e)) < S\x, R{x, n, 3e)) < )C\n, x, e) + C2 
and the proof can be concluded as above. □ 

Remark 43 We remark that if X is totally bounded but not compact 
all the above theorems hold with /C-^'^(x) instead of {x). 

We finally remark a connection with the theory exposed above 
and some applicative purposes. The algorithmic information content 
of a string is not a computable function, it is impossible to calculate 
AIC{s) for each s by an algorithm. By this then the information 
content of an orbit as it is defined in this paper is not computable. 

It follows that the concept of orbit complexity as it is defined in 
this paper is not a quantity that can be experimentally measured. 

To solve this problem let us consider a data compression algorithm. 
Since in the compressed string there is all the information that is 
necessary to reconstruct the original string an 'approximate' measure 
for the information content of the string is the length of the string after 
it is compressed by this coding procedure. This approximate measure 
is as accurate as efficient is the data compression procedure. 

Using compression algorithms instead of the algorithmic informa- 
tion content it is possible to obtain a 'computable' notion of orbit 
complexity. It can be proved that in the positive entropy case the 
computable orbit complexity is a.e. equivalent to the AIC based one 
( ||l^ , Q ) . Such a definition of computable orbit complexity allows nu- 
merical investigations about the complexity of unknown systems. Un- 
known systems underlying for example some given time series or ex- 
perimental data. 

In Q and [23| a particular compression algorithm is developed to 



apply these ideas to the weakly chaotic case and numerical investi- 
gations are performed by directly measuring the information content 
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of the orbits of some weakly chaotic system (e.g. the Mannevihe map 
and the logistic map at the chaos threshold ). The results agree with 
the theory exposed in this paper. 

In our opinion the existence of a computable version of the orbit 
complexity motivates from the applicative point of view the study of 
the orbit complexity itself and its relations between the other measures 
of the chaotic behavior of a system. 
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